METHOD AND APPARATUS FOR GENERATING RANDOM 
NUMBERS WITH IMPROVED STATISTICAL PROPERTIES 



FIELD OF THE INVENTION 

Aspects of the invention pertain to pseudo-random number generators. In 
particular, aspects of the invention relate to combining a plurality of 
pseudo-random number generators into a combined pseudo-random 
number generator, such that the combined pseudo-random number 
generator has better statistical properties than its constituent pseudo- 
random number generators. 

BACKGROUND OF THE INVENTION 

Random number generators and pseudo-random number generators have 
many practical applications, such as for encrypting digital computer 
messages and for performing simulations. Pseudo-random number 
generators are generally constructed using an algorithm that, in some 
cases, can be inferred by observing the output over a period of time. 

Attempts have been made to combine pseudo-random number generators; 
however, such attempts have typically yielded a combined pseudo- 
random number generator having worse statistical properties than its 
constituent components. For example, one prior art combined pseudo- 
random number generator uses a first pseudo-random number generator 
to populate a table of numbers, such as, one hundred numbers or a 
thousand numbers, or any quantity of numbers. A second pseudo-random 
number generator is used to generate indexes to the table populated by the 
first pseudo-random number generator. As numbers are selected from the 
table of numbers, the used entries are replenished by numbers generated 
by the first pseudo-random number generator. Using such a technique, a 
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combined random number generator with a very large cycle is produced; 
however, the combined pseudo-random number generator has worse 
statistical properties than the constituent pseudo-random number 
generators. For example, there may be more correlation among the 
random* numbers produced by the combined pseudo-random number 
generator than among the random numbers produced by its constituent 
parts, or the combined pseudo-random number generator may tend to 
have more repeated patterns than the numbers produced by its constituent 
parts. 

Consequently, there is a need to provide a random-number generator 
having improved statistical properties to meet the need for improved 
encryption and simulation among other things. 

SUMMARY OF THE INVENTION 

A method and an apparatus are provided for combining a plurality of 
random number generators into a combined random number generator. 
The outputs of the plurality of generators are interleaved into a combined 
stream of random numbers selected from each of the plurality of random- 
number generators. A value of x is calculated by each of the random 
number generators. Each of the values of x is mapped to a respective 
arrival time t for each of the random number generators. One of the 
random number generators having an earliest respective arrival time t is 
determined. A random number based on the arrival time t is generated. 

BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 shows an example of a prior art mixing of traffic streams; 
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Figures 2 through 4 illustrate an embodiment of the invention forming a 
combined random number generator from n constituent random number 
generators; 

Figures 5A and 5B are a flowchart for explaining processing in an 
embodiment of the invention; and 

Figure 6 shows an example of an apparatus for a combined random 
number generator. 

DETAILED DESCRIPTION OF THE INVENTION 

Queuing theorists and traffic engineers typically base analysis on an 
assumption that arrivals of events are distributed according to a Poisson 
process in time. This reflects the fact that not only is the mathematics 
involved particularly manageable, but also the assumption often reflects 
reality. Typically, when many traffic streams are mixed, a resulting 
stream is assumed to conform to the Poisson distribution. This fact has 
been used for models regarding telecommunications, vehicular traffic, 
faults in a system, and so forth. The present invention applies similar 
techniques to create a random number generator. 

Figure 1 shows an example of this mixing of many traffic streams. Here, 
n independent event streams or traffic streams, Sl-Sn, merge into a 
common stream 102. The resulting stream conforms more to a Poisson 
distribution as a value of n increases. When the inter-arrival times for the 
individual streams conform to Poisson distributions, the inter-arrival time 
of the combined stream 102 is Poisson for all n streams. When the inter- 
arrival times of the individual streams nearly conform to the Poisson 
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distribution, the inter-arrival time of the resulting stream becomes 
Poisson distributed for a small value of n. 



An embodiment of the combined pseudo-random number generator 
(CPRNG) approximates Poisson streams using individual independent 
pseudo-random number generators (PRNGs) which are combined to form 
a closely approximate Poisson stream. Uniformly distributed random 
numbers are then extracted from the stream. 

There are many ways of expressing Poisson arrivals. One way of 
expressing Poisson arrivals is in terms of the distribution of inter-arrival 
times, that is, the times between successive arrivals. For example, using a 
Poisson process, the probability p of having t seconds between adjacent 
arrivals is: 

P = Ae~* [EQUATION 1] 

where X is an average arrival rate. 

Figure 2 illustrates an embodiment of the invention 200 in which n 
random number generators (RNG's) 201, 202, 204, 206 each generate a 
respective value of x. Figure 2 shows each random number generator 
generating its first respective value of x. RNG#1 generates jc{, the first 
value of x for RNG#1, RNG#2 generates x 2 , the first value of x for the 
RNG#2, RNG#i generates x\, the first value of x for RNG#i, and so on, 
until all n random number generators have generated a respective value of 
x. 
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Each respective value of x is input to a respective converter 208 which 
converts a value of each respective x to a next arrival time. For example 
x\ is converted to , a first arrival time for RNG#1, xf is converted to tf , 
a first arrival time for RNG#2, x[ is converted to t[ , a first arrival time 
for RNG#i, and so on. 

Selector 209 then determines which one of the arrival times, t's, is an 
earliest arrival time. The earliest arrival time is selected from among the 
arrival times. If two or more arrival times, / 's 9 are equal, but less than all 
other arrival times, then any of the equal arrival times may be selected. 
Selector 209 then generates a random number P based on the earliest 
arrival time. Figure 2 shows Pj, the first random number generated by 
the CPRNG. Selector 209, via line 210, then causes the random number 
generator which had generated the selected earliest arrival time, to 
generate a next value of x. For example, if RNG#i had generated the 
earliest arrival time based on the first respective value of x, x{ 9 RNG#i 
will be caused to generate the second respective value of x, x' 2y which 
will then be converted by converter 208 to a second arrival time, t* 2 , for 
RNG#i. The selector then would examine the arrival times to determine 
the next earliest arrival time to produce P 2 , the second random number 
from the CPRNG. The process continues until a desired number of 
random numbers, P's> have been generated. 

Figure 3 illustrates a more detailed view of one embodiment of converter 
208. A value of x, for example, x' J9 the /* value from the i h random 

number generator, RNG#I, is received as input to xconverter 302 which 
converts x) to a probability number, for example, P) , the /* probability 
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number from the f h random number generator, such that 0 < Pj < 1 . Inter- 
arrival time calculator 304 converts the probability number, for example, 
Pj , to an inter-arrival time, for example, the f h inter-arrival time for the t h 

random number generator, Atj . Arrival time calculator then converts the 

inter-arrival time to a next arrival time, for example t) , the /* arrival time 

for the f h random number generator. The basis on which the various 
calculations can be made is explained later herein. 

Figure 4 illustrates a more detailed view of selector 209. Selector 209 
receives as input all of the next arrival times, t's. Comparator 402 
compares the next arrival times, and selects an earliest next arrival time 
(the smallest /). The comparator, via line 210, then causes the random 
number generator associated with the smallest arrival time to generate a 
next respective x. The comparator also passes the smallest next arrival 
time / to producer 404 to produce the next random number output from 
the CPRNG, for example, P h the i h random number produced by the 
CPRNG. 

Referring again to Figure 2, assume that the inter-arrival time of each of 
the n streams of random numbers from each uniformly distributed PRNG 
is independent of the n-1 other PRNG's generating inter-arrival times. 
Considering stream i, a corresponding PRNG, RNG#i, generates its j* 
pseudo-random integer x) , which is in a range from 0 to C;, where q is a 
maximum value generated by RNG#i. XConverter 302, shown in Fig. 3, 
within converter 208, converts x) to a probability number, for example, 

Pj 9 which is in a range such that 0<Pj <1. The conversion may be 

performed according to the following formula: 
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pi ___ v j * 
J (c, +1) 



[EQUATION 2] 



Pj is converted to an inter-arrival time, for example, Atj by inter-arrival 

time calculator 304 using an Inverse Cumulative Distribution Function 
(ICDF) for inter-arrival times. The ICDF can be determined by the 
following equation: 



where X i is an average arrival rate for random stream i and Atj is an 
inter-arrival time for the inter-arrival on stream /. 

Arrival time calculator 306 calculates a next arrival time by adding a 
previous arrival, time associated with the random number generator to the 
inter-arrival time, Atj to calculate a next arrival time. For example, t l s , 
the f h arrival time associated with the i h random number generator, 
RNG#i, can be calculated by adding the previous arrival time, t)_ x to 

inter-arrival time Atj . 

In other words, the f h arrival time on stream i is 



r 



(c'+l) 



-In 




4 



J 



[EQUATION 3] 




[EQUATION 4] 
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At any given time T, the next arrival in the combined stream will occur at 
/,- indicating that there have been i-1 arrivals on the combined stream prior 
to /,. The 1 th inter-arrival time for the combined stream, A/ f = *, which 
can be converted into a uniformly distributed probability Pi by using a 
Cumulative Distribution Function (CDF) for an exponential distribution: 




[EQUATION 5] 



Producer 404 calculates the i th probability for the combined stream, P h 
based on Equation 5, where A y . is the average inter-arrival rate for the j th 
stream and A/,, is the inter-arrival time for the i th stream. At i can be 
derived by: 

At, = /, - [EQUATION 6] 

In other words, the i t h inter-arrival time for the combined stream is equal 
to the (/**-!) arrival time subtracted from the arrival time. 

Given the smoothing properties when traffic streams are combined, the 
combined stream will more closely approximate a Poisson distribution 
than do the individual constituent streams. As a result, the P's 
corresponding to the Poisson process in the combined stream have 
superior and more uniform randomness than the values of Pj generated 

by the constituent PRNG's. 

Figures 5A and 5B show a flowchart which helps to explain the 
processing which occurs in an embodiment of the invention. At P500, an 
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arrival time associated with each of the random number generators is 
initialized to 0. 



At P502, each of the n random number generators is used to calculate a 
respective value of x. For example, a linear congruential random-number 
generator, defined by x i =(ax i . 1 +b)modulo(c+l) :> can be used to derive a 
next value of x. Note that the invention is not limited to being used only 
with linear congruential random-number generators, but may be used 
with a number of different random number generators. 

At P504, for each value of x, a respective probability number, Pj is 

x + 1 

calculated. The calculation can be determined by P) = . 

c § + 1 

At P506, a time increment or inter-arrival time for each probability 
number Pj is determined. This can be determined by calculating the time 

increment, Atj as shown in equation 3. 

At P508, a next arrival time for each of the random number generators is 
determined by adding the previous arrival time for a corresponding 
random number generator to a corresponding time increment or inter- 
arrival time Atj . 

At P510 a determination is made as to which one of the random number 

generators has an earliest next arrival time. If more than one random 

number generator has the same arrival time, any of these generators can 

be selected first and the remaining generator(s) having the same arrival 

time may be processed in any order, but before other random number 

generators having later arrival times. 
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At P514, a probability, for example, P, is determined by the following 
formula: 



Z4 

P=e iM J 



(EQUATION 7) 



where P, is the i 1 * probability generated for the CPRNG, X j is the average 

inter-arrival rate for the f h random number generator and t r ti-i is the (i**- 
1) arrival time subtracted from the i h arrival time, which equals the ? h 
inter-arrival time for the CPRNG. 

At P516, the probability, for example, Pi is provided as the generated 
random number from the CPRNG. Thus, the generated random number 
is a value between 0 and 1 . To produce a random number in a range, for 
example, 1 to 1000, the produced random number may be multiplied by 
1000. 

At P518, a new value of x is determined from the selected random 
number generator by using the selected random number generator to 
generate x. As mentioned above, the new value of x may be determined 
by using a linear congruential random-number generator or by using one 
of a number of different random-number generators. 

At P520, a probability number, for example, P) is calculated by adding 1 
to the new value of x and dividing that sum by 1+Ci, as previously 
described. 
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At P522, a time increment or inter-arrival time A/j corresponding to the 
probability number, for example, Pj is calculated. This can be 
determined according to equation 3. 

At P524, a next arrival time for the random number generator can be 
determined by adding the previous arrival time to the increment Atj and 

saving the next arrival time corresponding to the random number 
generator. 

Processes P510 through P524 continue to be repeated to generate each 
additional random number P im 

The above-described calculations can be simplified by assuming that the 
average arrival rate for each of the PRNG's is equal to 1. That is, X 
corresponding to the average arrival rate for each of the PRNG's is equal 
to 1. Making such an assumption, equation 3 becomes: 



At j =-ln(/>;) = -In 



[EQUATION 8] 



Further, equation 5 becomes: 

j> =e -»(r,-r,.,> [EQUATION 9] 

where is a difference between a value of the time at an I th arrival 
time and a value of time at a 0 th - 1) arrival time and n is the number of 
random number generators. 

Using the above simplified equations, new equation 8 can be used at 

P206 and P222, respectively, and new equation 9 can be used at P214. 
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In the embodiment shown in Figures 2 through 4, acts P504 and P520 are 
performed by the xconverter 302, acts P506 and P522 are performed by 
inter-arrival time calculator 304, acts P508 and P524 are performed by 
arrival time calculator 306, act P510 is performed by comparator 402 and 
acts P514 through P516 are performed by producer 404. 

Figure 6 provides an example of an embodiment of an apparatus for 
generating random numbers. In this embodiment, the apparatus includes 
a computer 600. Computer 600 has a CPU 602 which communicates 
with a memory 604. The memory may be random access memory or a 
combination of random access memory and read-only memory. The 
computer may also include disk drive 606 and disk 610 which resides in 
disk drive 606. The disk may be a floppy disk, a hard disk or an optical 
disk. The disk may include instructions for the CPU 602 to perform as a 
CPRNG. 

Computing a logarithm is typically a slow process on a computer. This 
can be substantially accelerated by previously generating a table of 
logarithms of integers. Therefore, the table can then be indexed by 
integer (x+1) and by integer (cfhl) to form ln(x+l) and ln(Cj+l). Since it 

is well known that * s equal to ln(a)-ln(b),- fa^ * + * J can be derived 

by using the table to determine the value of ln(Cj+l) and subtracting that 
value from ln(x+l) and changing the sign of the result. 

When fewer random number generators are used, for example, less than 
10, a linear search can be used to find an earliest next arrival time from 
among the arrival times corresponding to each random number generator. 
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However, when a larger number of random number generators are used, 
for example, 10 or more, a heap may be used to speed up the process of 
finding an earliest next arrival time from among the arrival times 
corresponding to each random number generator. 

Embodiments of the invention may be implemented in hardware, 
software, or firmware. The firmware may be in a read-only memory and 
the software may reside on a medium such as a floppy disk, optical, disk, 
or CD ROM, for example. 

While the invention has been described with reference to certain 
illustrated embodiments, the words which have been used herein are 
words of description, rather than words of limitation. Changes may be 
within the purview of the appended claims without departing from the 
scope and spirit of the invention in its aspects. Although the invention 
has been described herein with reference to particular structures, acts, and 
materials, the invention is not to be limited to the particulars disclosed but 
rather extends to all equivalent structures, acts, and materials, such as are 
within the scope of the appended claims. 
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